avcodec/decode: validate hw_frames_ctx when AVHWAccel.free_frame_priv is used
authorDmitry Rogozhkin <dmitry.v.rogozhkin-at-intel.com@ffmpeg.org>
Tue, 21 Nov 2023 05:57:32 +0000 (21:57 -0800)
committerSebastian Ramacher <sramacher@debian.org>
Sat, 2 Dec 2023 11:59:43 +0000 (12:59 +0100)
commitdfcfbb343942fa9bda521ced5c1cb9aa29456fcb
treed45dd60d3b5141c2976fdb652eb827db4c37970b
parentcd721163f8b2bd229cb350de766dd79e0e03a4ab
avcodec/decode: validate hw_frames_ctx when AVHWAccel.free_frame_priv is used

Validate that a hw_frames_ctx is available before using it for
the AVHWAccel.free_frame_priv callback, and don't require it to
be present when the callback is not in use by the HWAccel.

v2: check for free_frame_priv (Hendrik)
v3: return EINVAL (Christoph Reiter)
v4: better commit message (Hendrik)
v5: fix typo with missed frames_ctx (Lynne)

See[1]: https://github.com/msys2/MINGW-packages/pull/19050
Fixes: be07145109 ("avcodec: add AVHWAccel.free_frame_priv callback")
CC: Lynne <dev@lynne.ee>
CC: Christoph Reiter <reiter.christoph@gmail.com>
Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
Gbp-Pq: Name 0002-avcodec-decode-validate-hw_frames_ctx-when-AVHWAccel.patch
libavcodec/decode.c